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Abstract.  This  series  of  papers  addresses  three  interrelated  problems: 

The  solution  of  a variational  problem,  the  solution  of  integral  equations, 
and  the  solution  of  an  initial  valued  system  of  integrodifferential  equa- 
tions. It  will  be  shown  that  a large  class  of  variational  problems  requires 
the  solution  of  a non-linear  integral  equations.  It  has  also  been  shown 
that  the  solution  of  a non-linear  integral  equation  is  identical  to  the 
solution  of  a Cauchy  system.  In  this  paper,  we  by-pass  the  non-linear  in- 
tegral equations  and  show  that  the  minimization  problems  directly  implies  a 
solution  of  the  Cauchy  system.  This  second  paper  in  the  series  look  at 
semi -quadratic  functional  and  scalar  functions. 

Keywords.  Variational  problems,  integral  equations,  parametric  imbedding. 


1.  Introduction 

Many  optimization  problems  result  in  variational  problems  of  finding 
a function  z(t),  0 t£  1,  that  minimizes  the  functional 

W[z]  = ^ /q  ■^0  z(s)k(t,s)z(t)dtds  + 2 F(z(t),t)dt. 


s' 


By  standard  variational  techniques  it  can  be  shown  that  the  optimal  function,  sr 

■ f Sec..\,.i  Cl 

u(t),  satisfies  a non-linear  Fredholm  integral  equation  (Ref.  1).  Recent  □.! 

work  in  the  study  of  integral  equations  (Ref.  2)  has  shown  that  solutions 
of  non-linear  integral  equations  are  requivalent  to  solutions  of  particular 
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initial  valued  systems  of  integrodifferential  equations  (Cauchy  Systems). 

It  appears  that  the  three  problems  --  variational,  integral  equations, 
and  Cauchy  Systems  — are  equivalent  to  each  other.  An  important  missing 
link  in  the  analysis  has  been  the  demonstration  that  the  variational  problem 
leads  directly  to  a Cauchy  System  without  passing  through  an  integral  equa- 
tion. These  papers  provide  that  link. 

2.  Derivation 

Suppose  we  desire  to  find  a scalar  function  z(t),  0^  t^  1,  which 
minimizes  the  semi-quadratic  functional 

W[z,x]  = X z(s)k(t,s)z(t)dsdt  + 2 /J  F(z(t),t)dt,  (1) 

where  k (t,s)  is  a symmetric,  positive  definite  Kernel,  F(z,t)  is  a convex, 
twice  differentiable  function  in  z,  and  x is  a sufficiently  small  scalar 
parameter.  This  class  of  problems  is  semi -quadratic:  because  the  first  term 
is  a quadratic  functional  in  z.  This  is  more  general  than  it  might  look  at 
first  glance,  for  the  choice  variable  may  actually  be  a function  (x(t)  and 
z(t}  might  be  a composite  function. 

z(t)  « h(x(t))  (2) 

where  h is  a convex,  differentiable  function.  By  simple  change  of  varia- 
bles this  more  general  problem  may  be  reduced  to  (1).  The  standard  varia- 
tional approach  to  this  problem  results  in  a non-linear  integral  equation 
which  the  optimal  function  must  satisfy. 


Proposition  2.1.  The  function  u(t)  which  minimizes  W[z;x]  must 
satisfy  the  integral  equation 


F^(u(t),t)  + A /J  k (t,s)u{s)ds  = 0,  0 <_  t 1.  (3) 

Throughout  the  paper,  the  partial  derivative  of  F with  respect  to  its  ith 
argument  is  denoted  by  F^  and  the  derivative  of  u(t,A)  with  respect  to  x 
is  denoted  by  U^(t,x). 

The  proposition  is  established  as  follows.  The  arbitrary  admissible 
functions  may  be  written  as 

z(t)  = u(t)  + en(t),  (4) 

where  e is  an  arbitrary  scalar,  and  n(t)  is  an  arbitrary  function.  Take  a 
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Taylor  series  expansion  of  W[Z,x]  in  e,  ignoring  all  terms  in  e or  higher. 
This  results  in 

W[z,x]  = WCu,x]  + cC[u,ri>x]  (5) 

where 

C[u,n,x]  = A /q  /q  k(t,s)u(s)n(t)dsdt  + a /q  /J  u(t)k(t,s)n(s)dsdt 

+ 2 ;J  F^(u(t),t)n(t)dt.  (6) 

Optimality  requires 

eC[u,n»A]  ^ 0 (7) 

For  all  e,ii.  Since  e has  arbitrary  sign,  this  implies 

C[u,ntA]  * 0.  (8) 


1 
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Using  the  synmetry  of  k(t,s),  variables  of  integration  may  be  relabeled  so 
that  Eq.  (8)  is  expressed  as 

X /q  k(t,s)u(s)n(t)dsdt  + /J  F^(u(t),t)n(t)dt  = 0 (9) 

for  all  arbitrary  n(t).  Applying  the  fundamental  lemna  of  the  calculus  of 
variations  to  Eq.  (9)  results  in  the  desired  integral  equation.  This  completes 
the  proof. 

Another  approach  to  the  minimization  problem  is  to  ask  how  the  optimal 
solution  changes  as  A varies.  This  is  referred  to  as  parametric  imbedding. 

The  basic  idea  of  parametric  imbedding  is  to  convert  the  non-linear  integral 
equation  into  a system  of  initial  valued  integro-differential  equations.  The 
basic  result  given  in  Ref.  2 is 

Proposition  2.2.  The  function  u(t,A)  which  satisfies  the  non- 
linear integral  Eq.  (3)  parameterized  by  a is  the  solution  to 
the  following  initial  valued  integrodifferential  equations,.. 
aucpnented  by  a resolvent  kernel  K(t,s,A),  and  conversely: 

Uj^(t,A)  + a(t,A)  + A /J  K(t.S,A)a(S,A)dS  = 0 (10) 

K^(t,S,A)  + 6(t,S,A)  + /q  K(t,s' ,A)«(s*,s,A)ds'  = 0 (11) 


F^(u,(t,0),t)  » 0 

K(t,s.O)  + k(t,s)/F^,(u(t,0).t)  = 0 


where 


»(t,A)  « k(t,s)u(s,A)ds/F^^(u(t,A),t) 
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6(t,s,x)  = Y(t,s,A)  + /J  k{t,sbK(s\s,x)/F^^(u(t,x),t)ds^ 


+ A Y(t,s^A)K(s\s,A)ds^ 

(15) 

Y(t,s,A)  = ^ (k(t,s)/F^^(u(t,A),t)) 

(16) 

For  0<  t^l,  0<_S^1. 

The  Cauchy  System  (10) -(16)  has  been  very  useful  for  the  computation  of 
solutions  of  non-linear  integral  equations,  whether  or  not  they  arise  from  a 
variational  problem.  Well-known  techniques,  such  as  the  Runge-Kutta  or 
Adams-Moulton  methods,  together  with  the  methods  of  lines,  are  readily  avail-  j| 

able.  See  Ref.  3 for  one  such  example.  In  addition,  there  are  many  cases  ^ 

where  the  parameter  A has  an  interesting  physical  interpretation  and  thus  H 

ja" 

the  Cauchy  System  provides  all  the  equations  needed  to  study  the  sensitivity 
of  the  solution  to  changes  in  important  parameters 

It  will  now  be  shown  that  the  Cauchy  System  (10) -(16)  may  be  derived  i j 

directly  from  the  semi -quadratic  minimization  problem  without  ever  writing  | 

down  the  non-linear  integral  Eq.  (3).  This  shows  that  the  solution  of  the  J 

variational  problem  could  have  proceeded  even  if  the  integral  equation  had  I 

never  been  discovered.  The  Cauchy  System  is  perfectly  adequate  for  describ-  | ! 

ing  the  optimal  function  u(t,A).  I 


Proposition  2.3.  The  function  u(t,A)  which  minimizes  W[u,a]  must 
satisfy  the  Cauchy  System  (10) -(16). 


The  proposition  is  established  as  follows.  Let  u(t,A)  be  the  solution 
of  the  minimization  problem  for  parameter  value  a,  and  let  u(t,A'HlA)  be  the 


\ 
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i 

f- 

1. 

r 

solution  for  x+dx.  Admissible  solutions  to  the  variational  problem  may  be 
expressed  as 

z(t,x)  = u(t,x)  + en(t),  (17) 

x(t,x+dx)  = u(t,x+dx)  + op(t),  (18) 

where  e and  a are  arbitrary  scalars  and  where  n and  p are  arbitrary  functions. 

Approximate  W[z,x]  and  W[x,  x+dx]  by  a Taylor  series  in  the  first  argument. 

2 2 

When  e and  a are  suitably  small  the  terms  in  e and  a or  higher  may  be 
ignored.  The  resulting  approximations  are 

W[z,x]a  W[u,x]  + eC[u,n.x]  + higher  order  terms  (19) 

W[x,X+dx]  arW[u,X+dx]  + aC[u,p,X+dx]  + higher  order  terms  (20) 

where 

C[u,n,x]  = 2 X /J,  /q  k(t,s)u(s,x)n(t)dsdt 

+ 2 /J,  F^(u(t,x).t)n(t)dt  (21) 

C[u,p,x+dx]  = 2(x+dx)  /g  k(t,s)u(s,x+dx)p(t)dsdt 

+ 2 /J  F^(u(t,x+dx),t)p(t)dt  (22) 


7 


for  all  e.a.n.p.  Since  these  are  arbitrary,  select  e = -a  and  n * p so 
that  (23)  and  (24)  are 

-aC[u,p,x]  ^ 0,  (25) 

aC[u,p,X+dA]  ^ 0.  (26) 

Add  these  two  inequalities  to  get 

o(C[u,p,X+dx]  - C[u,p,x])  0.  (27) 

Since  o has  arbitrary  sign,  this  implies  that 

C[u,p,x+dx]  - C[u,p,x]  = 0,  (28) 


for  all  arbitrary  p.  Expand  C[u,p,x+dx]  in  a Taylor  series  in  x+dx;  ignoring 

2 

terms  with  (dx)  or  higher  this  gives 

C[u,p,x+dx]  3 C[u,p,x]  + dx  {2  /q  /q  k(t,s)u(s,x)p(t)dsdt 

+ 2x  /Jj  /q  k(t,s)uj^(s,x)p(t)dsdt 

+ 2 /Jj  F^^(u(t,x),t)u^(t,x)p(t)dt.}  (29) 

Hence  for  dx  sufficiently  small,  Eqs.  (28)  and  (29)  imply  that  the  term  in 
brackets  in  Eq.  (29)  must  be  zero  for  all  arbitrary  p(t).  Apply  the  funda- 
mental lemma  of  the  calculus  of  variations  and  we  have 

F^l(u(t,x),t)Uj^(t,x)  + k(t,s)u(s,x)ds 

+ X /g  k(t,s)uj^(s,x)ds  = 0. 


(30) 


Divide  Eq.  (30)  by  F^^(u(t,x),t)  and  we  have  the  linear  Fredholm  integral 
equation  in  the  unknown  function  u^(t,x) 

Uj^(t,x)  + oi(t,x)  + X /q  m(t,s,x)  Uj^(s,x)ds  = 0,  (3 

where  a(t,x)  is  defined  in  Eq.  (14)  and  m(t,s,x)  is  defined  by 

m(t,s,x)  = k(t,s)/F^^(u(t,x),t)  (3 

A linear  Fredholm  integral  equation  with  kernel  m(t,s,x)  has  a solution 
that  may  be  expressed  using  a resolvent  kernel  K(t,s,x)  as  follows 

U^(t,x)  + a(t,x)  + X /jj  K(t,s,x)a(s,x)ds  = 0.  (3 

This  is  Eq.  (10)  of  the  Cauchy  System.  The  resolvent  kernel  must  satisfy 
a related  linear  Fredholm  integral  equation  (see  Ref.  2), 

K(t,s,x)  + m(t,s,x)  + X /q  m(t,s' ,x)K(s' ,s,x)ds'  * 0.  (34 

Differentiate  (34)  with  respect  to  x to  get 

K^(t,s,x)  + Y(t,s,x)  +*  /q  m(t,s',x)K(s' ,s,x)ds' 

+ X /q  Y(t,s' ,x)K(s' ,s,x)ds' 

+ X m(t,s' ,x)Kj^(s',s,x)ds'  = 0,  (35 

where  Y(t,s,x)  is  defined  in  Eq.  (16).  Since  Eq.  (35)  is  also  a linear 
Fredholm  integral  equation  with  a kernel  m(t,s',x)»  its  solution  may  be 
expressed  using  the  same  resolvent  kernel. 


Kj^(t,s,x)  + 6(t,s,x)  + /Jj  K(t,s' ,x)«(s' ,s,x)ds'  = 0 (36) 

where  6(t,s,x)  is  defined  in  Eq.  (15).  This  is  Eq.  (11)  of  the  Cauchy 

system.  When  x = 0 in  the  original  minimization  problem,  W[u(t,0),0]  | 

is  minimized  when  F(u(t,0),t)  is  minimized  for  each  t.  This  implies  • 

1 

that  j 

F^(u(t,0),t)  = 0 (37)  ! 

l! 

which  is  the  initial  condition  (12).  The  initial  condition  (13)  follows 

from  Eq.  (34)  by  setting  x = 0.  This  completes  the  proof.  !! 

3.  Discussion  ! 

The  objective  of  this  paper  has  been  to  reduce  the  semi- quadra tic 
variational  problem  in  Eq.  (1)  to  the  Cauchy  System  in  relations  (10)-(16). 

In  particular  we  have  been  able  to  do  this  without  making  any  use  of  the 
Euler  equation,  which  takes  the  form  of  the  non-linear  integral  equation  (3). 

The  earlier  paper  in  this  series  (Ref.  4)  demonstrated  that  the 
reduction  could  be  performed  in  the  quadratic  case.  In  this  paper,  the  I 

general  technique  of  direct  reduction  is  made  more  explicit.  The  objective 
functional  is  approximated  first  in  a Taylor  series  in  the  choice  function 
and  then  in  a Taylor  series  in  the  parameter  x.  It  would  have  been  possible 
to  derive  the  non-linear  integral  equation  along  the  way  but  this  was  not 
done  in  order  to  arrive  the  sensitivity  Eqs.  (10) -(16).  This  general  tech- 
nique may  be  applied  to  problems  which  are  not  semi -quadratic  and  which 
have  a vector  of  choice  functions.  This  Siiproach  may  be  used  to  develop 
new  equations  for  such  variational  problems  as  the  team  decision  problem,  s 


Ref.  5,  or  the  simplest  problem  in  the  calculus  of  variations. 
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